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Abstract 

Background: There has been a recent proliferation in the development of smartphone applications (apps) aimed 
at modifying various health behaviours. While interventions that incorporate behaviour change techniques (BCTs) 
have been associated with greater effectiveness, it is not clear to what extent smartphone apps incorporate such 
techniques. The purpose of this study was to investigate the presence of BCTs in physical activity and dietary apps 
and determine how reliably the taxonomy checklist can be used to identify BCTs in smartphone apps. 

Methods: The top-20 paid and top-20 free physical activity and/or dietary behaviour apps from the New Zealand 
Apple App Store Health & Fitness category were downloaded to an iPhone. Four independent raters user-tested 
and coded each app for the presence/absence of BCTs using the taxonomy of behaviour change techniques 
(26 BCTs in total). The number of BCTs included in the 40 apps was calculated. Krippendorff's alpha was used to 
evaluate interrater reliability for each of the 26 BCTs. 

Results: Apps included an average of 8.1 (range 2-1 8) techniques, the number being slightly higher for paid (M = 9.7, 
range 2-18) than free apps (M = 6.6, range 3-14). The most frequently included BCTs were "provide instruction" (83% of 
the apps), "set graded tasks" (70%), and "prompt self-monitoring" (60%). Techniques such as "teach to use prompts/cues", 
"agree on behavioural contract", "relapse prevention" and "time management" were not present in the apps reviewed. 
Interrater reliability coefficients ranged from 0.1 to 0.9 (Mean 0.6, SD = 0.2). 

Conclusions: Presence of BCTs varied by app type and price; however, BCTs associated with increased intervention 
effectiveness were in general more common in paid apps. The taxonomy checklist can be used by independent raters to 
reliably identify BCTs in physical activity and dietary behaviour smartphone apps. 

Keywords: Behaviour change techniques, Smartphone applications, Apps, Lifestyle, Physical activity, Diet, mHealth, 
Reliability 



Background researchers have begun to examine novel approaches to 
Lifestyle behaviours, such as diet and physical activity, deliver behaviour change interventions. Mobile and wire- 
are modifiable risk factors associated with many non- less technology (mHealth) is a growing area in the preven- 
communicable diseases (NCDs), which account for 63% tion and management of NCDs and holds potential to 
of deaths worldwide [1]. To date, many intervention deliver health-related behaviour change interventions 
programs targeting physical activity and dietary changes [6-8]. Mobile phone ownership has reached saturation in 
have had modest effects and their long-term effective- many developed countries with an increase in smartphone 
ness is not well established [2-5]. Thus, public health ownership. A 2012 survey in the United States (U.S.) of 

three thousand adults indicated that 85% owned a mobile 
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Despite the recent proliferation of apps to promote 
positive lifestyle change, there is a dearth of research evi- 
dence regarding their effectiveness. Further, content ana- 
lysis of existing apps have identified gaps between 
evidence based guidelines and app content relating to 
smoking cessation [10,11], weight loss [12,13], diabetes 
[14] and exercise [15]. While theoretically grounded 
mHealth behaviour interventions increase the likelihood 
of achieving behaviour change, it has been suggested 
that current theories are inadequate to guide mHealth 
interventions, which need to be more interactive and dy- 
namic [16]. Abraham and Michie have suggested that 
there are a number of behaviour change techniques 
(BCTs) common to many health behaviour theories [17], 
of which at least five are evident in effective physical ac- 
tivity and dietary interventions (i.e. self-monitoring, 
intention formation, specific goal setting, review of be- 
havioural goals and feedback on performance) [18]. 
While studies have been conducted to determine the ex- 
tent to which behaviour change theory has been applied 
to app development, none have quantified the extent to 
which specific BCTs are included. 

The present study sought to determine the presence/ 
absence of BCTs in the top 20 free and top 20 paid 
physical activity and dietary smartphone apps from the 
New Zealand iTunes Apple App Store Health & Fitness 
category. A second aim was to determine whether the 
BCTs taxonomy checklist could be used to reliably iden- 
tify BCTs in smartphone apps. 

Methods 

Study design 

A comparative assessment of the presence of BCTs 
within smartphone apps from the New Zealand Apple 
App Store Health & Fitness category was undertaken by 
four independent raters. The raters were all trained in 
health behaviour change; one dietetics and nutrition 
masters student, two health sciences doctoral students 
and one health psychologist. The study was conducted 
in accordance to ethical standards. Human subjects were 



400 Health & Fitness category 
apps limited to most popular ; 
200 free j 
200 paid j 
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not recruited and therefore no ethics approval was 
required. 

Sample 

The apps were located and downloaded using the soft- 
ware 'iTunes' on November 12 of 2012 (available for 
download at www.apple.com/itunes). To be included in 
the present evaluation apps had to be designed either to 
promote health or prevent disease, and specifically ad- 
dress physical activity and/or dietary behaviours. Irrele- 
vant and miscategorised apps under the specified Health 
& Fitness category or apps addressing other health be- 
haviours were excluded. Apps were identified within the 
Health & Fitness category of iTunes by clicking on the 
"Top" ordering function button (i.e. "Top Paid iPhone 
Apps" and "Top Free iPhone Apps"). Their titles and de- 
scriptions were initially screened by the first author. 
Apps that met the inclusion criteria were downloaded 
until a total of 20 was achieved. This procedure was re- 
peated to retrieve the 20-top paid and 20-top free apps. 
During screening, nine top-paid and 11 top-free apps 
were excluded for not meeting the inclusion criteria (see 
Figure 1 for an overview of the sampling procedure). All 
apps were downloaded to an iPhone 4 or 5 running iOS 
6.0.1 (version of Apple operating system for iPhones). 

Measurement 

The Taxonomy of Behaviour Change Techniques Used 
in Interventions and the Coding Manual to Identify 
Behaviour Change Techniques in Behaviour Change 
Intervention Descriptions were used for the present 
evaluation [17]. Abraham and Michie previously devel- 
oped and demonstrated the feasibility and reliability of 
using the taxonomy for identifying BCTs in behavioural 
interventions. The coding manual provides guidelines to 
detect whether an intervention description includes any 
or all of the 26 defined BCTs. Mean kappa values of 0.80 
and 0.82 (i.e. good reliability) have been observed when 
applying the taxonomy of BCTs to physical activity and 
healthy eating intervention descriptions, respectively 
[17]. Each app was rated for inclusion of each of the 26 



20 apps excluded as unrelated to 
physical activity and dietary 
behaviours 

8 sleep apps 

3 menstrual period tracker apps 

3 heart rate meters apps 

1 horoscope app 

1 fundraising app 

3 magazines apps 

1 pregnancy app 



Figure 1 Selection of sample of apps. Procedure for selection of sample of physical activity and dietary apps. 
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BCTs. Formal statistical comparisons in terms of differ- 
ences in the number of BCTs between apps were not 
conducted for the following reasons. First this was an 
exploratory study to determine whether an existing cod- 
ing system could be used reliably to assess BCTs among 
mobile phone apps. Second, given the number of apps 
assessed in this study and the potential for differences in 
BCTs between apps, the number of comparisons needed 
would likely result in Type 1 error. 

Procedure 

For each app, descriptive information was retrieved 
regarding its popularity (i.e. frequency of downloads 
relative to other apps within the same category), average 
rating (i.e. average number of stars the app was rated 
ranging one to five), total ratings (i.e. number of users 
who downloaded the app and voluntarily rated it), total 
"hate it", "don't like it", "its ok", "its good", and "its 
great" ratings (i.e. number of times the app was rated 
with one to five stars, respectively), customer reviews 
(i.e. number of times the app was reviewed) and price 
(as shown in Additional file 1). Every app was evaluated 
by four independent raters using three iPhones between 
November 2012 and April 2013. The four raters separ- 
ately tested all apps in detail to become familiar 
with the interfaces, menus, features, and functionality 
(e.g. "profile", "routes", "workouts", "friends", "meals", 
"charts", "analysis", "my plan", "nutrition", "settings", 
"tips & tricks", "FAQ"). The apps were user- tested in- 
dependently by each rater. 

Prior to evaluation, all raters read the BCTs definitions 
carefully and had the opportunity to clarify and discuss 
the definitions. Before beginning a coding session raters 
read each BCT description carefully to ensure clear dif- 
ferentiation between techniques. After using each app, 
raters reviewed each of the menu functions to rate the 
presence or absence of BCTs according to the checklist. 
A dichotomous score of "0" absent or "1" present was 
applied for each of the 26 BCTs. Disagreements were re- 
solved by consensus discussion. 

Statistical analyses 

All statistical analyses were conducted using IBM SPSS 
Statistics version 20.0. Frequencies and percentages of 
each of the 26 BCTs included in the 40 apps were calcu- 
lated. Krippendorff s alpha was used to evaluate interra- 
ter reliability for each of the 26 BCTs. This statistic is 
appropriate because it can be used with any number of 
observers, sample sizes, and satisfies all criteria for a 
good measure of reliability [19]. Further, a macro that 
computes Krippendorff s alpha is available for statistical 
software packages, such as SPSS [19]. 



Results 

The majority of the 40 apps reviewed targeted physical 
activity (30 apps, 75%), followed by dietary behaviour 
(6 apps, 15%), and combined behaviours (4 apps, 10%). 
Attributes of the paid and free apps are presented in 
Table 1. Generally, apps were rated in iTunes customer 
ratings as good (mean = 4.1 on a scale of one to five 
stars). Free apps were on average rated more times 
(193.4) and had more customer reviews (108.7) than 

Table 1 Descriptive data of the top-40 apps 
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Descriptive data of the top-40 apps from the New Zealand Apple App Store 

Health & Fitness category (Mean, (Standard Deviation), [Range]). 

Note. Standard Deviations appear in parentheses below means; Ranges appear 

in brackets below SD. PA = Physical Activity; BCTs = Behaviour Change 

Techniques. 
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paid ones (35.9 and 22.9, respectively). The average rat- 
ing was slightly higher for paid (4.2) compared to free 
apps (3.9). 

Overall, apps included an average of 8.1 (range 2-18) 
BCTs, with slightly more BCTs present for paid (mean = 
9.7, range 2-18) as compared to free apps (mean = 6.6, 
range 3-14) (see Figure 2). Commonly included BCTs 
were "provide instruction" (83% of the apps), "set graded 
tasks" (70%), and "prompt self-monitoring" (60%). "Model/ 
demonstrate the behaviour" (53%), "provide opportunities 
for social comparison", "plan social support/social change" 
and "prompt identification as a role model" were also fre- 
quently incorporated (55%). "Prompt barrier identification", 
"prompt self-talk", and "motivational interviewing" were 
seldom included (3%), and "teach to use prompts/cues", 
"agree on behavioural contract", "relapse prevention" and 
"time management" were not included. "Prompt intention 
formation", "provide general encouragement", "prompt spe- 
cific goal setting", "prompt self-monitoring of behaviour", 
and "prompt practice" were techniques included more fre- 
quently in paid compared to free apps. 

Reliability data are presented in Table 2. Coefficients 
ranged from 0.1 to 0.9 with a mean of 0.6 (SD = 0.2), in- 
dicating moderate reliability. Raters agreed that none of 
the apps used BCT15 "teach to use prompts/cues", 



BCT16 "agree on behavioural contract", BCT23 "relapse 
prevention" and BCT26 "time management". Despite 
100% agreement, the calculation of alphas for these 
techniques was not possible because there was no vari- 
ation in the reliability data matrix [19]. Of the 22 reli- 
ability tests, seven (32%) yielded alphas of more than 0.7, 
indicating good reliability, and only two (9%) were below 
0.4. Inferior reliability was observed for four techniques: 
BCT2 "provide information on consequences" (0.4), 
BCT3 "provide information about others' approval" 
(0.4), BCT5 "prompt barrier identification" (0.1), which 
was only observed once, and BCT6 "provide general 
encouragement" (0.4). 

Discussion 

This study identified the presence or absence of BCTs in 
popular physical activity and/or dietary behaviour apps. 
There was substantial variation in the numbers of BCTs 
present, with an average of eight techniques per app. 
Using a taxonomy and coding manual it was possible 
to identify BCTs used in smartphone health behaviour 
change applications. Beyond these general observations, 
specific issues are outlined below. 

Previous research has already highlighted the shortage 
of theoretical content present in interactive technologies 



8. Provide instruction 
7. Set graded tasks 
12. Prompt self -monitoring of behaviour 
21. Prompt identification as a role model 
20. Plan social support/social change 
19. Provide opportunities for social comparison 
13. Provide feedback on performance 
9. Model or demonstrate the behaviour 
2. Provide information on consequences 
4. Prompt intention formation 
17. Prompt practice 
10. Prompt specific goal setting 
6. Provide general encouragement 
1 . Provide general information 
14. Provide contingent rewards 
1 1 . Prompt review of behavioural goals 
3. Provide information about others' approval 
24. Stress management 
18. Use follow-up prompts 
25. Motivational interviewing 
22. Prompt self-talk 
5. Prompt barrier identification 
26. Time management 
23. Relapse prevention 
16. Agree on behavioral contract 
15. Teach to use prompts/cues 




All 

i Paid 
i Free 



80 90 



Figure 2 Incorporation of BCTs within the top-40 apps. Percentage of apps incorporating each of the 26 BCTs within the Top-40 Applications 
from the New Zealand Apple App Store Health & Fitness category by cost and overall. 
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Table 2 Reliability of BCT identification 



Technique Krippendorf s a 

1. Provide general information .57 

2. Provide information on consequences .41 

3. Provide information about others' approval .38 

4. Prompt intention formation .57 

5. Prompt barrier identification .10 

6. Provide general encouragement .41 

7. Set graded tasks .81 

8. Provide instruction .66 

9. Model or demonstrate the behaviour .82 

10. Prompt specific goal setting .52 

1 1 . Prompt review of behavioural goals .47 

12. Prompt self-monitoring of behaviour .85 

13. Provide feedback on performance .54 

14. Provide contingent rewards .60 

15. Teach to use prompts/cues * 

16. Agree on behavioural contract * 

17. Prompt practice .56 

18. Use follow-up prompts .46 

19. Provide opportunities for social comparison .88 

20. Plan social support/social change .88 

21. Prompt identification as a role model .90 

22. Prompt self-talk .66 

23. Relapse prevention * 

24. Stress management .85 

25. Motivational interviewing .66 

26. Time management * 
Mean .62 



Reliability of BCT identification in the top-40 apps from the New Zealand 
Apple App Store Health & Fitness category: Krippendorf's alpha per technique. 
Note. *- Input reliability data matrix exhibits no variation. BCTs = Behaviour 
Change Techniques. 

such as web sites [20] and apps [10,12,14] designed 
to promote health behaviour change [11,13,15,21,22]. 
Consistent with previous research, our findings demon- 
strate the relative absence of behaviour change strategies 
present in physical activity and dietary apps. Moreover, 
this study highlights the potential to improve future app 
development by incorporating key strategies known to 
enhance behaviour change. For example, existing tech- 
nologies permit real time assessment, feedback, and tai- 
loring, however, in the present study, only 38% and 23% 
of the apps prompted specific goal setting or prompted 
review of behavioural goals, respectively. 

The five BCTs shown to be commonly associated with 
greater effectiveness for modifying physical activity and 
diet in previous studies were present to varying degrees 
in the apps reviewed here (i.e. self-monitoring - 60% of 



apps, intention formation - 50%, specific goal setting - 
38%, review of behavioural goals - 23% and feedback on 
performance - 53%). However, these five BCTs were in 
general more common in paid versus free apps. BCTs 
such as relapse prevention, which is important for sus- 
tained behavioural change [23] was not present in any of 
the reviewed apps, which questions the value of these 
apps for changing behaviour in the long-term. 

The observed differences in reliability identifying BCTs 
indicate the need to clarify definitions and/or coding in- 
structions. We evaluated the presence of BCTs using a 
coding instrument originally developed to identify BCTs 
from written text in published papers describing an 
intervention [17]. Perhaps specific coding instructions to 
apply when assessing the active ingredients of mHealth 
or interactive technologies such as apps or video games 
can be developed. The present research included a tax- 
onomy of 26 techniques; however, subsequent taxon- 
omies have been developed [24]. Future content analysis 
of apps should apply this updated hierarchical version of 
the BCT taxonomy. 

While identifying the active content of health behav- 
iour change interventions is crucial, researchers must be 
aware of the caveats of ascribing effectiveness to certain 
BCTs or combinations of BCTs. To do so, researchers 
should also consider the parameters for effectiveness for 
each BCT. These are the required characteristics that a 
translation of a BCT to usable intervention elements 
must incorporate (i.e., an effective BCT is undermined if 
not correctly applied) [25]. Additionally, the effectiveness 
of BCTs is determined by contextual factors such as tar- 
get population (e.g., sample characteristics), behavioural 
domain (e.g., physical activity, smoking) and study de- 
sign factors (e.g., follow-up period, blinding). Further, 
BCTs frequently co-occur in interventions and they can 
interact with each other [25]. Hence, conclusions about 
the behaviour change potential of apps based on incorp- 
oration of BCTs should be interpreted cautiously as 
BCTs are not effective under all conditions. Caution 
interpreting our findings in terms of differences in the 
number of BCTs between apps is also warranted as we 
did not conduct formal statistical comparisons. 

The increasing number and diversity of apps available 
makes its assessment a difficult task for the public and 
clinicians to differentiate which apps can be useful in 
promoting behaviour change. Presumably, the value of 
apps can be enhanced by developers incorporating more 
features, theory, and BCTs into their apps, which in turn 
will increase the behaviour change potential of the app. 
The current study suggests the higher potential quality 
of paid apps should be a factor to weigh when selecting 
and using apps for personal use, clinical intervention, or 
future research. Furthermore, guidelines can be created 
to influence and help app developers as to which BCTs 
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(and other components) to include that likely will en- 
hance the behaviour change potential of apps. 

Despite the proliferation of physical activity and diet- 
ary apps, it is not clear whether they are effective at 
modifying behaviour. At present, there is a dearth of 
effectiveness data of app-based interventions to promote 
healthy behaviours [26], and robust, rigorously con- 
ducted and adequately powered trials are required to 
determine their effectiveness. On the other hand, app 
development proceeds at a rate that far out paces time 
frames typically observed in trial development and con- 
duct. Thus, more dynamic forms of evaluation methods 
are required to determine the effectiveness of such tech- 
nologies [27]. Generally, the effectiveness of mHealth in- 
terventions such as text messaging for modifying health 
behaviours (e.g., smoking cessation) has been established 
[28]; however the effectiveness of more complex and dy- 
namic mHealth interventions including apps has yet to 
be determined. 

A strength of this study was the use of an established 
instrument to systematically rate the incorporation of 
BCTs in the respective apps. However, in the present 
study, the presence of BCTs was determined by user- 
testing the apps rather than from text descriptions. 
Some app features were not explicit during use. For ex- 
ample, reminders, weekly updates, and pop-up feedback, 
etc, may have occurred for one, but not all raters at any 
given time. Despite these issues, modest reliability be- 
tween raters was observed (0.6). Another strength was 
the use of four raters, with a range of behaviour change 
experiences, which provided a more comprehensive as- 
sessment of the apps and the use of the taxonomy 
checklist. A major limitation of this study was not in- 
cluding apps from other app stores such as the Google 
Play Store/Android platform, or app stores from other 
countries besides NZ, which limits the generalisability of 
the findings. Nevertheless, we investigated the most 
popular and commonly downloaded apps of the iTunes 
Apple App Store Health & Fitness category, which rep- 
resent a sample of apps that many people are using and 
therefore increases the study relevance. Of note, apps 
may exist that incorporate more evidence based BCTs 
than those included in the study sample as we only rated 
the most popular apps. Furthermore, technology has a 
dynamic nature with new apps and updates developed 
every day, consequently, these evaluations need to be 
updated periodically. 

The advantages of mobile phone (mHealth) solutions 
compared to other health intervention delivery modes 
include the persistent interactivity, personalisation and 
engagement, potential to make healthcare more access- 
ible and scalable, more cost-effective and more equitable 
[29]. Such characteristics provide significant potential to 
assist in disease prevention strategies and supporting 



sustained change in lifestyle behaviours. However, there 
are too many apps for consumers and professionals to 
choose from [30]. In addition, the majority within the 
health & fitness category of the Apple iTunes U.S. store 
scored less than 40 out of a possible 100 for functional- 
ity according to a recent report from the IMS Institute 
for Healthcare Informatics that concluded apps do little 
more than providing information [31]. Emerging evi- 
dence demonstrates the need for collaboration between 
health behaviour change experts and app developers to 
create apps that include effective BCTs. Future research 
is also needed to better understand how individuals use 
apps after downloading them, and to investigate features 
that may impact user acceptability and preference [32]. 

Conclusions 

Presence of BCTs varied by app type and price; however, 
BCTs associated with increased intervention effective- 
ness were in general more common in paid apps. The 
BCTs taxonomy checklist can be used by independent 
raters to reliably identify BCTs in physical activity and 
dietary behaviour smartphone apps. 

Additional file 



Additional file 1: Characteristics Of The Apps. Characteristics Of 
The Study Sample Of Physical Activity And Dietary Apps. Microsoft Word 
Document. This table provides the characteristics of the study sample of apps. 
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